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Executive Summary 

This study sought to determine whether the use of standardized test scores contributes 
any useful information regarding First Time in College (FTIC) students’ probable 
success at USF, using more detailed analysis of underrepresented minorities and 
women, who Micceri (2009) shows, experience substantial negative bias relative to 
males and whites on such tests. 



Methods 

Combined historical USF admissions, degrees granted and enrollment data from 
Academic Year (AY) 1999 through 2008 were analyzed for FTIC matriculants from AY 
1999 through 2003 thereby allowing a minimum of six complete academic years for 
graduation. Academic progress was defined by a six level progress variable ranging from 
1, failure to complete three USF hours or maintain a 2.0 GPA to 6, earning a USF BA or 
BS. Pre matriculation predictor variables included a concordance of the highest of SAT 
or ACT total scores (Dorans, 1997), high school GPA, high school class rank, transfer 
hours, geographical region, race/ethnicity and sex. All of these, except the tests, have 
previously shown at least minimal relationships with various definitions of academic 
progress. Descriptive and multiple regression analyses were conducted. 

Findings 

Consistent with all historic research on the topic, in this study, standardized tests failed 
to relate with academic progress at USF. The SAT/ACT regression beta weights were 
slightly negative (Table 1, Table 2), and, as Figure 2 indicates, the highest SAT/ACT 
scores occurred among the lowest two progress levels, while the lowest test values 
occured at the highest academic progress level (BA/BS). Further, as Figure 1, Figure 2, 
Figure 6 and Figure 7 show, use of these tests as criteria perpetuates discrimination 
against both women and all minorities, including Asians, and a greater level of 
discrimination against underrepresented minorities when viewed from this more 
thorough academic progress definition. Figure 6 and Figure 7 show that tests are almost 
completely flat across academic progress levels for African American and Hispanic 
students and therefore provide no useful information regarding college performance. 
Perhaps the only group for whom tests may possibly be of some value is Asians, where 
the only technically meaningful differences (60 points or more, ETS, 2001) occurred 
between those in the lowest progress group (<3 hrs/< 2.0 USF GPA) and those in the 
highest (USF BA/BS earned). Note that both high school GPA and class rank exibit a 
comparatively monotonic positive upward trend as the acadmic progress level increases 
for all racial/ethnic groups and both sexes (Figure 3 throught Figure 7). None of the 
differences between adajcent progress levels are meaningfully different, it is the trends 
that are important and meaningful. Appendix A provides details for these findings. 

Conclusion 

Consistent with Micceri (2009), it appears that the use of test scores as admissions 
criterion for either females (from any racial/ethnic group), or underrepresented 
minorities (from any racial/ethnic group), negatively discriminates in favor of whites 
and males when viewed from the perspective of academic progress at USF. It would 
appear that ceasing to use such measures for females and minorities would be the most 
egalitarian admissions approach given current and historical research findings. 
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Introduction and Background 

This study sought to determine whether the use of standardized test scores contributes 
any useful information regarding First Time in College (FTIC) students’ probable 
success at USF, using more detailed analysis of underrepresented minorities and 
women, who Micceri (2009) shows, experience substantial negative bias relative to 
males and whites on such tests. Research questions of interest were: 

1. Do underrepresented minorities, females and/or overrepresented minorities (e.g. 
Asians) exhibit different entry test scores than majority students (e.g. white)? 

2. Do differences on test scores associate meaningfully with academic progress for 
underrepresented minorities, females or any other classification group? 

Methods 

Combined historical USF admissions, degrees granted and enrollment data from 
Academic Year (AY) 1999 through 2008 provided data to evaluate student performance 
and success at USF relative to admission qualifications in general and standardized tests 
in particular. Specific attention was directed at female and underrepresented minority 
performance. The sample included only First Time In College (FTIC) students who 
matriculated between summer 1999 and spring 2003, thereby assuring at least six (6) 
years for degree completion. Admissions variables evaluated were high school GPA, 
high school class rank, the number of transfer hours, the ACT composite, the SAT total 
score, plus a combined SAT/ACT score based on the highest of SAT or ACT using the 
ETS SAT/ACT concordance (Dorans, 2008; Dorans, et. al., 1997). Additionally, 
geographic source defined as USF Region or not was dummy coded based on historic 
findings that local students tend to out-perform others. A progress variable included 
hours earned at USF, a student’s final USF GPA, their final class level (upper or lower), 
and the level of degree earned at USF (AA/AS, BA/BS). Full-time/part-time enrollment 
would have been used as a context variable, however, unfortunately, for the 2002 and 
2003 cohorts, the full-time indicator frequently reflects part-time USF enrollment 
combined with enrollment at a community college, thus, this flag was not used. 

Analyses 

Analyses included (1) descriptive comparisons of students’ USF performance relative to 
the tests separately by race/ethnicity and/or sex and (2) multiple regression to 
determine which, if any of the high school based predictor variables contributed a 
reasonable amount to predicting success at USF. Because an earlier study (Micceri, 
Brigman, Spatig, 2009), had found the strongest relationship between predictor 
admission variables and USF outcomes to occur for a combined USF GPA and Hours 
completed variable, a comparable ordinal variable was created in this study with the 
following levels: 1 = fewer than 3 hrs completed or less than a 2.0 USF GPA, 2 = between 
three and 15 USF hours completed, 3 = more than 15, but less than 30 completed hours, 
4 = 30 to 59 hours completed, 5= more than 60 hours completed, upper level standing, 
or a USF AA/AS earned, and 6 = a USF BA or BS earned. The analyses involving 
graduation were limited to 16,854 USF FTIC students who matriculated between 
summer 1999 and spring 2003 and for whom complete data were available. This 
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sample, using a last degree granted semester of spring 2009, allows all students a full six 
years to complete a baccalaureate degree (highest scaled value of 6). 

Results and Discussion 

Please note that several charts in this report use a truncated y-axis to better show 
changes or differences among groups. Appendix A provides detailed tables. 

Initial analyses sought to determine whether differences in test scores occurred for 
different levels of progress/achievement at USF. Figure 1 tells us that for the highest of 
SAT or ACT scores (SAT/ACT), only among Asians does a meaningful difference occur 
(60 points) 1 between any progress levels, with an 80 point gap between those who failed 
to earn three hours or a 2.0 USF GPA, and those who earned a BA/BS. Overall, the lines 
across academic progress levels are relatively flat, indicating no relationship. Figure 1 
shows the clear discrimination against all minorities that these standardized tests 
always exhibit. 2 Note that the apparent upward jump among African Americans from 
upper-level/AA to BA appears to be idiosyncratic, because all four lower levels show 
almost no increase to the BA level. However, the increase for Asians appears real, and is 
a bit greater than between other levels (not 60 points, however). Micceri (2009) shows 
that the test discrimination among Asians drops quite a bit as high school GPA 
increases. This likely relates to affluence and the resultant better Standard English plus 
reduced cultural bias among such students, both of which prove to be factors in scoring 
higher on standardized tests (Hodgkinson, 1999 ; Mortenson, 2000 ; Micceri, 2009 ). 

Figure 1 



Mean SAT/ACT by Progress by Race/Ethnicity 



Asian 
Black 
Hispanic 
-x— Other 
-a- White 



<3 hrs <=15hrs 15-30 hrs 30-60 hrs AA-Uplev BA/BS 




1 ETS (2001) 

2 See Micceri (2009) for a thorough empirical exposition of this discrimination. 
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Perhaps Figure 2 best displays the relationship between tests (the highest of SAT or ACT 
scores = SATACT) and Academic Progress, where 1 in the HRSLEV (Progress variable) 
represents < 2.0 or < 3 hrs, and 6, a BA/BS degree. Clearly, the distribution of scores at 
every progress level extends through nearly the entire range of possible SATACT scores 
(400 to 1600), 3 with the highest scores occurring for the two lowest levels of progress 
and the lowest scores (below 500) occurring among those earning a BA/BS degree. The 
higher scores among those completing between three and fifteen USF hours for all 
admission selection source variable investigated in detail, (Figure 1, Figure 3, and Figure 
4) and, when viewed together, suggest that this phenomenon may be influenced by 
transfers in good standing from USF to other higher education institutions. However, 
even after considering this possible confound, one must ask the question: “Is it possible 
to say that this chart in any way suggests that these tests convey useful information 
regarding a prospective student’s probable success at USF?” 

Figure 2 




1 2 3 4 5 6 



HRSLEV 



3 Note that 3.5% of students in the sample having a test were admitted with a SATACT below 800. 
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Figure 3 depicts high school GPA by academic progress with a truncated y-axis and 
indicates that, unlike test scores, high school GPA does show a relatively consistent 
increase as academic progress improves consistently for all race/ethnic groups, with one 
exception. The exception is that students completing only 3-15 credit hours with a USF 
GPA above 2.0 exhibited higher entry GPAs than those completing 15-30 and 30-60. 
This is a rather interesting curve, and suggests that the 3-15 hours group may contain a 
disproportionally large number of students who transfer from USF in good standing, as 
might the dip in class rank at upper-level/AA (Figure 4). 



Figure 3 



Mean HS GPA by Progress by Race/Ethnicity 
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Black 

Hispanic 

Other 

White 



<3 hrs <=15 hrs 15-30 hrs 30-60 hrs AA-Up lev BA/BS 
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Figure 4 indicates that High School Class Rank exhibits somewhat erratic trends relative 
to progress for both Asian and Other students, and particularly among Other students. 
Again note, as was related above, that the high values for 3-15 hours completed may 
relate to transfers. Despite having a comparatively large dip for both Asians and Others 
beyond the 3-15 hours level, both groups exhibit a fairly substantial increase between 
having less than three hours or a < 2.0 USF GPA (lowest progress level), and attaining a 
bachelors degree. Interestingly, for Asians, those attaining either Upper Level status, or 
an AA degree have the same mean class rank as those attaining a baccalaureate degree. 
Unlike the Asian and Other groups, the African American/Black, Hispanic and White 
groups all exhibit a comparatively steady increase in mean class rank as progress levels 
increase with the exception that upper-level/AA attainment is usually lower than 30-60 
hours. Further, these three groups don’t show the higher values at 3-15 hours exhibited 
by both Asian and Other students. Note that a relatively high percentage of Other 
students are either aliens or multi/mixed race/ethnicity. 



Figure 4 



Mean HS Class Rank by Progress by Race/Ethnicity 
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Figure 5 exhibits academic progress separately by sex for all students and clearly 
exhibits standardized tests’ bias against females (Micceri, 2009), as males score higher 
than females at every level of progress on the SAT /ACT, while females score higher than 
males at every level of progress on both high school GPA and class rank. It is also well 
documented that females outperform males at the ultimate college success criterion, 
graduation, even in Engineering (Micceri, 2009). Thus, higher grades and class ranks 
make sense, but the tests appear to discriminate against women. As in all other cases, 
the trend lines for tests are comparatively flat for both sexes, with a slight increase at the 
BA/BS level, while both high school GPA and class rank show a comparatively steady 
increase from the lowest academic progress level to the highest for both sexes. 



Figure 5 
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Figure 6 and Figure 7 depict respectively levels of academic progress separately by sex 
for African American and Hispanic groups. Consistent with all other figures, males score 
higher on the flat test trend lines while females score higher on the upward trends for 
class ranks and GPA. Note, however, that for both of these groups, the trend lines 
appear somewhat flatter for all admissions measures than for the total group. 



Figure 6 
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Figure 7 



Hispanic - f/ean SAT /ACT Progress by Sex 
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Male 



Hispanic -Mean HS GPPA Progress by Sex 




Mean HS Class Rank Progress by Sex 
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